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Abstract. We study a neural network model in which both neurons and synaptic 
interactions evolve in time simultaneously. The time evolution of synaptic interactions 
is described by a Langevin equation including a Hebbian learning term, and a bias 
term which is the interactions of the Hopfield model. We assume that synaptic 
interactions change much slower than neurons and study the stationary states of 
synaptic interactions by the replica method. We find that the order of the phase 
transition changes from the second to the first and that the existence regions of the 
Hopfield attractor and mixed states increase as the coefficient of the learning term 
increases. We also study the AT stability of solutions and find that the temperature 
region in which the Hopfield attractor is stable increases as the learning coefficient 
increases. Theoretical results are confirmed by the direct numerical integration of the 
Langevin equation. Further, we study the characteristics of the resultant synaptic 
interactions by partial annealing and find that the stability of the attractor which 
emerges after partial annealing is enhanced and those of the coexistent attractors are 
reduced. 
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1. Introduction 



In this paper, we consider the double dynamics of neurons and synaptic interactions. 
In particular, we study the case that the time evolution of neurons is so rapid that 
synaptic interactions are considered to be constant when the average of correlations of 
neurons are calculated. We study the stationary states of the system by the replica 
method. In this study, the replica number n can be any value and the n — > limit is not 
taken unlike the usual replica method. The case in which the synaptic interactions do 
not change we refer to as "quenched", whereas the case in which they change together 
with neurons we call "annealing". The present case in which synaptic interactions 
change much slower than neurons is intermediate and is called "partial annealing" . Such 
systems have been studied previously, e.g., the case that synaptic interactions learn the 
Hebbian rule [H El [3], the case that the replica number is negativejl], and the case that 
synaptic interactions are divided into a hierarchy of several groups with adiabatically 
separated and monotonically increasing time-scale [5]. In this paper, we study the effect 
of the Hebbian learning in partial annealing introducing the coefficient of the Hebbian 
learning. If the coefficient is negative, we can study the case of unlearning. In this 
paper, we mainly study the case of learning, and study the states of neurons and the 
resultant synaptic interactions when the system reaches to the stationary state [6j [7J. 
Similar analyses are under investigation for the Mexican-hat type interactions [7] and 
for the Amit model [8j. 

In the next section, we give the formulation of the model and study the saddle 
point equations, the AT stability and the phase transitions. In section 3, the results 
of numerical simulations are presented and are compared with theoretical results. In 
section 4, we study the nature of interactions generated by partial annealing. In section 
5, a summary and discussion are given. In appendix A, we give the analysis of the AT 
stability compactly. 



2. Formulation 



2.1. Model 

We consider iV neurons. Let Uj represent the state of zth neuron which takes values ±1, 
(Tj = 1 is the firing state and o~i = — 1 is the rest state. We assume Jy evolves in time 
according to the following Langevin equation[2]: 

d 



T — 

dt 



11 FT 

t<j = l,---,N (1) 



The first term (o"jCTj) sp is the expectation value of the correlation between zth and jth 
neurons and represents the Hebbian learning. We assume that this is calculated by the 
canonical distribution with the Hamiltonian H with the instantaneous values of at 
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time t. 

(o-i<Jj) S p = — Tr{ ai ye~ pH (TiVj, (2) 
Zp 

H{{o-i\) = - - JijWj, (3) 

Zp = Tr {a} e-P H . (4) 

Here, Tr{ CT } denotes the summation of all configurations of neurons {<7i}. Zp is the 
partition function of neurons, e is the learning coefficient. The second term is the 
basic synaptic interactions, to which converges if the learning term and the external 
noise do not exist. In this paper, as Kij we take the Hopfield model with p patterns, 

The third term —fiJij represents the relaxation and is introduced so that does not 
diverge. The last term rjij is a white Gaussian random variable with the mean and 
the following covariance: 

(Vi j (t)Vki(t'))=2f8 ik 5 jl 8(t-t'). (6) 

Here, T represents the strength of the noise, "noise temperature". The coefficients 
and ^= are scaling factors so that the system has non-trivial limit as iV — > oo. By 
defining TL as 

tt = -£i^ + ^£4-| ln ^> (7) 

i<j z i<j p 

the Langevin equation is rewritten as follows: 



dJij 1 &H . ,.s.fT 



t- 



dt NdJij llJX J \ N 



+ Vij(t)\Tf (8) 



In the stationary state of eq.(jHJ), the probability density P({Jij}) of the synaptic 
interactions is given by 

P({J y }) oc e-fr (9) 

p = i- ( 10 ) 

Thus, the partition function Z^ of the total system is expressed by 
Z e = JdJe-> n 

= /AK* e -*»"E«4+«E«*E^W. (U ) 

Here, cf J = cZJy and n = £%. Now, we calculate by the replica method regarding 
n as an integer. Introducing n replicas a], a 4 2 , . . . , cr", is expressed as 

n 

Z n P = II Tr K} e-^«<» 

a=l 

= T^ }e 0£i<i J «£ a «+*£^£««* (12) 
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We define order parameters and q a/3 as 



i 

Then, we obtain the following expressions: 



(13) 
(14) 

(15) 
(16) 

G * = 7V 2 + o S & + O + 2^ E(<)2 + ^ E ^ (17) 

4^ 2/i/5 Q<(3 4/i/3 a>1/ 

(18) 

(19) 
(20) 



G — G\ + G2 + G3, 



G 2 = - E QapQap + E ™Z m l-> 

a</3 a,u 

= m { lr{ cr a}e z -^ a< ' 3 p } . 



Since we consider the finite number of patterns p and take N — > 00 limit in this paper, 
N ^> 2 P holds. Therefore, in the first equation of the expression G3, — ^ can be 

i 

replaced by the average over {£}. We denote this average by [• ■ ■] and get the second 
equality. 

Now, we assume the replica symmetry (RS) as 

q a p = q, 



Qa/3 = q, 

ml = m v . 



(21) 



Let G i: Rs be Gi evaluated at the RS solution. Then, we obtain the following expressions 
for G 1iRS ,G 2i rs and G 3jR s' 



G 1 



,RS 



G2,RS 
G3,RS 



^PK 2 + 
4// fip 4 

+ (3n^2h u m u , 



(3 2 n{n-l) 2 P 2 n (3K 



<t + - — - + 



E 



4:fJL$ tyy/P V 



n > m, 



n(n- 1) . ^ A 
qq + n ^ m„m,;, 



q- 2 n + 



In / Dxj cosh (y\J~£[x — rh u ^ j 



(22) 
(23) 

+ nln2, (24) 



dx 

Dx = , e 2 . 



2tt 
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2.2. Saddle Point Equations (SPEs) 



Defining Grs = G\rs + G2 rs + G 3 rs, we obtain the following saddle point equations. 

K f3 2 

Here, we put h v — and define J = and k = — -. 



= and define J 

dG RS 

dq 
dG RS 

dq 
dG RS 
dm v 
dG RS 
dm u 



: q = nq, 

0:q= J Dx cosh™ S tanh 2 s{ J Dx cosh" 2}^ 
: rh v = —(3Jm u , 



: m L 



C J Dx cosh™ 3 tanh h{ / Dx cosh" s}" 



3 = y/Kqx + j3 Jm v ^ u . 

In this paper, we study the case of p = 3 and abbreviate the SPEs as 

q = <p(q, mi, m 2 ,m 3 ), 

m u = tp u (q,m 1 ,m2,m 3 ), (v = 1,2,3). 

We find the following solutions of the SPEs. 

• P : g = , m M = 0, paramagnetic solution, 

• : q > , m M = 0, spin-glass solution, 

• H : q > , mi 7^ , m 2 = m 3 = 0, Hopfield attractor, 

• 2M : q > , mi = m 2 7^ , m 3 = 0, mixed state with 2 patterns, 

• 3M : q > , m,\ = m 2 = m 3 7^ 0, mixed state with 3 patterns. 

In this paper, we analyze the Hopfield attractor (H), the mixed state with 
(3M) and spin-glass state (SG). We do not consider the mixed state with 
(2M) because it is expected to be unstable. 



(25) 

(26) 

(27) 

(28) 
(29) 

(30) 
(31) 



3 patterns 
2 patterns 



2.3. AT stability 

We study the AT stability of the RS solution[9]. The condition of the stability is that 
the free energy increases when order parameters deviate from those at the RS solution. 
The free energy per neuron /s is given by 



h 



N (5 



(32) 



We define small deviations from the RS solution by 



mf = m u + e° 



q a p = q + V 



a/3 
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and expand G up to the second order of deviations. Then, G is expressed as 

G = G RS + - £(^)(£M<C e M + 9 G(au)(i3y)e"v Py 

z WHO) 

+ \ E^MX^V, (33) 

(a/3)( 7 5) 

Grs = G \ qafj=q ^ =mu . 

Q is called the Hessian. The stability condition of the RS solution is that all eigenvalues 
of Q are negative. We calculated all eigenvalues for H, 3M and SG. There exist 7 
different kinds of eigenvalues for H and 3M, and 5 different kinds of eigenvalues for SG. 
Details are given in Appendix. 



2.4- Phase Transition 

In this subsection, we study the phase transition. The second order phase transition 
temperatures are determined by the following relations: 

T™ H =r|l d 3M = -^ = J, (34) 



rplnd 
I P^SG 



1 



\ 



I, (35) 



'«3 

(e^p-l)<Z + lj, (36) 

rp2nd rp2nd tQ7\ 

1 SG-*3M — 1 SG^H- 

Since the second order phase transition temperature from P to H, Tp 1 ^, and that from 
P to 3M , Tp^ 3M , are equal, we denote them by T]p_^ M . Here M implies both of H and 
3M. Similarly, since Tjgl^ and TgQ d _^ 3M are equal, we denote them by T|g.^ M . Next, 
we study the first order phase transition. In this case, a new phase appears suddenly 
irrespective of the old phase from which the transition takes place. Thus, we consider 
the following three phase transitions and obtain the equations to determine the phase 
transition temperatures. 

(i) Transition to H 

Q = <p(q, mi, 0,0), (38) 
m i = ^1(9,^1,0,0), (39) 

^ dq^^ dm^ dm 1 dq ^ 

(ii) Transition to 3M 

q = (p(q,m,m,m), (41) 
m — i(ji(q,m,m,m), (42) 

^ dq^^ dm) dm dq ^' 
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Derivatives in the above equations are calculated as 

dip! d 



dm dm 



ipi(q, m, m, m) 



dipt d^ dipi _ dip! 2 dipi 



dm\ dm2 dm% dm\ dm2 ' 
dip dip dip dip g dip 



dm dmi dm2 dm 3 dm\ 
(iii) Transition to SG 

q = ^,0,0,0), 

dip = 1 

dq 



(44) 
(45) 



We solve the above equations numerically and determine the phase transition 
temperatures. 

Hereafter, we fix K = 1 and \i = 1 and change T, T and e. We display the 
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Figure 1. Phase transition lines in T — e plane. Left panel: f — 0.1. Right 
panel: f = 0.4. K = 1.0 and [i = 1.0. Solid curve: T^ M , short dashed 
curve:Tp"^gQ, dashed-dotted-dotted curve: T|gl M , long dashed curve:T^ s *, dashed- 
dotted curve:^ 1 ^, dotted curve:Tgg. 



phase transition lines in T — e plane for T = 0.1 and 0.4 in Fig. (TJ and those in T — T 
plane for e = 1.0 and e = 3.0 in Fig. [2, respectively. From these figures, we note the 
following. There is a tendency that the order of the phase transition changes from the 
second order to the first one as e increases for H, 3M and SG or T decreases for 
H and 3M. The interval of the temperature in which a solution exists increases as e 
increases for H, 3M and SG or T decreases for H and 3M. In the right panel of 
Fig. [31 we display the temperature dependence of q for T = 0.1 and e = 1.0. For three 
cases of H, 3M and SG, when the temperature is decreased, a pair of solutions emerge 
at the temperature of the first order phase transition, and two solutions are separated 
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Figure 2. Phase transition lines in T — T plane for e = 1.0 and e = 3.0. K = 1.0 
and /i = 1.0. Solid curve: T^m, short dashed curve: 

t p^sg> dashed-dotted-dottcd 
curve:Tjg^ M , long dashed curve:T^ s *, dashed-dotted curve^ 1 ^, dotted curve:T|^. 



and consist of the upper and lower branches as the temperature is further decreased. 
Examining the AT stability, we find that the upper branch is stable and lower branch 
is unstable for H and 3M, whereas the both branches of SG are unstable. As seen 




Figure 3. Temperature dependence of q. T — 0.1. Left panel: e = 0.5. Right panel 
e = 1.0. K = 1.0 and fi = 1.0. Solid curve: stable solution. Dotted curve: unstable 
solution. 
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Figure 4. Temperature dependence of q. T = 0.4. Left panel: e = 0.5. Right panel 
e = 1.0. K = 1.0 and fj, — 1.0. Solid curve: stable solution. Dotted curve: unstable 
solution. 

in the left panel of Fig. [3] for T = 0.1 and e = 0.5, H emerges by the first order phase 
transition, and SG emerges by the second order one. For 3M, it is difficult to determine 
the order of the phase transition in this figure, but by Fig. [5] we find that it is the second 
order. The upper branch of H is stable whenever it exists, but 3M is stable only at 
low temperatures. 

In Fig. HI we display the temperature dependence of q for T = 0.4, the left panel 
is for e = 0.5 and the right panel is for e = 1.0. We note that H becomes unstable in 
low temperatures for e = 0.5 and that there exist regions where SG is stable. 

The second order phase transition temperature Tp"^ H = Tp^ 3M depends on T but 
not on e. From this fact together with the fact that when the first order phase transition 
takes place the upper branches of H and 3M are stable for large e and small T and the 
upper branch of H is stable for large e and large T, we can understand that the stable 
temperature region of the upper branch increases when e is increased with fixed T. In 
Fig. El we display the phase diagram in T — e space taking into account the stability of 
the solutions. 

In Table 1, we show the phase transition temperature of H, , that of 3M, T C M , 
and the ratio r of the stable temperature region for 3M to that for H by taking into 
account the AT stability for several values of e and T = 0.1. We note that T C H , T C M and 
r increases as e increases from 0. 

3. Simulations 

We performed direct integrations of the Langevin equation ([1]) fixing r = 1, K — 1 and 
/i = 1 and changing parameters T, T and e. We used the Euler method with the time 
increment At = 0.1. We adopted the following procedure according to ref. 2). When 
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Figure 5. Phase diagram in T — e space. K = 1.0, yU = 1.0, Upper panel: T = 0.1, 
Lower panel: T = 0.4. Solid curve: Tf^ M , short dashed cwrve:Tp^gQ, dashed-dotted- 
dotted curve:T|Q d _ M , long dashed curve-.Tjf* , dashed-dotted curve^g 1 ^. Dotted 
horizontal lines indicate the parameter where simulations were performed. Dotted 
curves denote phase boundaries which are not calculated theoretically but estimated 
by numerical data available. 
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Table 1. T = 0.1, K = l,/i = 1.0. Phase transition temperature of the Hopfield 
attractor (H) and the mixed state with 3 patterns (3M), and the ratio r of the stable 
temperature region for 3M to that for H by taking into account the AT stability for 
several values of e. 







H 


3M 




stable reg 


ion for 3M 






r = 


stable re; 


^ion for H 


e = 





0.58 


0.27 


0.47 






e = 


0.5 


0.61 


0.38 


0.62 






e = 


1.0 


0.83 


0.68 


0.82 






e = 


1.5 


1.07 


0.92 


0.86 







N times of update by the Monte Carlo method are tried, we call it 1 Monte Carlo step 
and denote it by 1[MCS]. 

(i) Set an initial state of interactions «/(0). 

(ii) Update neurons cr by Ri [MCS]. 

(iii) Calculate (cjCrj) during the R 2 [MCS] update of neurons. 

(iv) Update J by the Euler method. 

(v) Repeat 2 to 4 i? 3 times. 

(vi) Calculate averages of physical quantities during the _R 4 repetitions of 2-4. 

In this procedure, the total number of updates of neurons is + -R2X-R3 + -R4) [MCS]. 
As Rs, we took R 1 = R 2 = R 3 = R 4 = 500. 

First, we show the numerical results together with theoretical ones for the Hopfield 
attractor in Figj6j Parameters are T = 0.1, e = 0.5, 1.0, 1.5 and TV = 1000. Numerical 
results agree fairly well with the upper branch solution obtained theoretically. Next, the 
theoretical and numerical results are shown for the mixed state, in FigJTl Parameters 
are T = 0.1, e = 0.5, 1.0.1.5 and iV = 2000. The agreement between simulations and 
the stable upper branch solution by theory are quite well, except for two cases. One 
is just above the critical temperature for e = 1.0 and e = 1.5. In the paramagnetic 
phase, fluctuations are very large. The other is around the temperature where the AT 
instability takes place for e = 0.5. In this case, the phase transition takes place at the 
temperature which is lower than the theoretical prediction. Results in both cases are 
considered to be finite size effects. 

4. On the nature of interactions generated by partial annealing 

Here, we numerically study the interaction { J^} which appears when the system reaches 
to the stationary state. There are two types of such interactions. One is {J^} for which 
H emerges at the stationary state, and the other is {Jif} for which the 3M emerges. 
Using these two interactions, we performed Monte Carlo simulations taking two initial 
conditions, H and 3M. 
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0.2 0.4 0.6 0.8 1 1.2 

T 

Figure 6. Temperature dependence of mi, 7712,717,3 for the Hopfield attractor for 
e = 0.5, e = 1.0 and e = 1.5. T = 0.1, A" = 1.0 and /i = 1.0. Curves are theoretical 
results. Solid curves are stable and dotted curves are unstable. Symbols are simulation 
results for N = 1000. 

In Fig. [HI we display the time series of for T = 0.1, e = 1.0 and T = 0.4. We 
found that when the interaction is {Jfj}, the neuron system converges to H, whereas 
when the interaction is {Jff}, it converges to 3M, irrespective of initial conditions. In 
Fig. [9j we display the theoretical and simulation results for the temperature dependence 
of mi,m 2 and 1TI3 for T = 0.1 and e = 1.0. In the left (right) panel of Fig. M, at each 
temperature, the interaction {Jfj} ({Ji"/}) is used and the initial condition is 3M (H). 
As seen from these figures, the resultant attractor by the Monte Carlo simulation is H 
for {Jfj} and 3M for {J if} respectively, irrespective of the initial conditions. This 
implies that partial annealing has the effect to enhance the stability of the resultant 
attractor and to reduce that of coexisting attractors. 

5. Summary and discussion 

We investigated the change of the system behaviors by partial annealing in which the 
synaptic weights change but much slower than the neurons. As the basic interaction, we 
took that of the Hopfield model, and introduced the coefficient e of the Hebbian learning. 
We studied the stationary states of the Langevin equation by changing parameters, those 
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Figure 7. Temperature dependence of mi,m2,m3 for the mixed state 3M for 
e = 0.5, £ = 1.0 and e = 1.5. T = 0.1, if = 1.0 and /li = 1.0. Curves are theoretical 
results. Solid curves are stable and dotted curves are unstable. Symbols are simulation 
results for N = 2000. 



are the learning coefficient e, the neuron "temperature" T and the synaptic weight 
"temperature" T. 

First, we studied the phase transition lines in (T,e) and (T,T) planes and found 
there is a tendency that the order of phase transitions of solutions becomes the second 
to the first as e increases or T decreases. 

Next, by taking into account the AT stability, we drew phase diagrams in (T, e) 
plane for T = 0.1 and 0.4. For T = 0.1, we found that the stable parameter regions 
for the Hopfield attractor and the mixed state with 3 patterns increase as e increases. 
Further, we found that the ratio of the stable region of 3M to that of the Hopfield 
attractor increases as e increases. For T — 0.4, we found that SG appears by the second 
order phase transition from P for small e and it is the only stable solution. When e is 
large, the Hopfield attractor appears by the first order phase transition, and the stable 
region of the Hopfield attractor increases as e increases. We confirmed the theoretical 
results by the numerical simulations, except for the finite size effects observed only for 
a few set of parameters. 

In order to study the nature of interactions generated by partial annealing, we 
performed the Monte Carlo simulations using the synaptic weights obtained by partial 
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Figure 8. Time series of mi,m,2,ms. Numerical results (N = 500). K = l,fj, = l,r = 
1. T = 0.1, e = 1.0, T = 0.4. Left panel. Interaction {J if}, in which H appears during 
partial annealing, is used. Right panel. Interaction {Jff}, in which 3M appears 
during partial annealing, is used. Initial state. Solid curve: mi = l,m2 = = 0. 
Dashed curve: mi ~ ni2 ~ m3 ~ 0.5. Dashed dotted curve: random configuration. 
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Figure 9. Temperature dependence of mi,m 2 ,m,3. T = 0.1, e = 1.0. Curves are 
theoretical results of partial annealing and symbols are simulation results (N = 500). 
Left panel. At each temperature, interaction {Jfj} in which H appears during partial 
annealing is used. Initial state is 3M. Right panel. At each temperature, interaction 
{J if} in which 3M appears during partial annealing is used. Initial state is H. 
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annealing. As a result, we found that the stability of the attractor which emerges as the 
result of partial annealing is enhanced and that of the coexistent attractors are reduced. 

In the present model, the case of T = and e = is nothing but the original 
Hopfield model. In this case, the Hopfield attractor and 3M are stable for low 
temperatures. We numerically confirmed that the Hopfield attractor is stable for all 
values of e when it exists for T = 0.1 although there is a possibility that it may be 
AT unstable when T is very low for T > 0. On the other hand, for T = 0.4 we found 
the region in which the Hopfield attractor becomes AT unstable with the replicon mode 
eigenvalue A3 > indicating replica symmetry breaking. This happens when e is less 
than 1. Thus, it is concluded that if e is larger than some value which depends on T, 
the larger e is, the wider the temperature region of the stable Hopfield attractor is. 

From Fig. [5j we note that for small value of e, partial annealing can not widen the 
stability region of the Hopfield attractor. In particular, it seems that when e becomes 
negative, i.e. in the case of unlearning, no significant change happens in the phase 
diagram. We consider that this is because the loading rate of patterns, a = is 
in this study. If a is positive and large, results might change. This is an interesting 
unsolved problem. 

Appendix A. AT stability of solutions 

In this Appendix, the eigenvalues and eigenvectors of the Hessian are calculated. In the 
below, the symbols a, (3, 7 and 5 indicate the replica indexes and symbols \i and v do 
the pattern induces. 

Let the Hessian matrix Q be the L x L matrix. L is the summation of the dimensions 

of {e"} space and that of {r] al3 } space, i.e., L = 3n + n C2 = for p = 3. The 

eigenvalue equation is expressed as 



where A is an eigenvalue of Q and /x is the eigenvector belonging to A. takes the 
following form: 



{e"} and {?? } denote a 3n dimensional and a n C2 dimensional column vectors, 
respectively. In the below, [• • •] is the average over patterns £ and a bar denotes the 
following average: 



(A.l) 




(A.2) 




(A.3) 



(A.4) 




K 



K 



V 



(A.5) 



(A.6) 
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Further, (• • •) denotes the following average at the replica symmetric solution. 

_ Tr^--- 
{ '" } Tr a e" ' 

a<j3 oiv 

= nq 2 ]T ^ + E m„a a C. 

a</3 otv 

Appendix A.l. Hop field attractor 

We put nil = m , m 2 = m 3 = 0. Then, the non-zero elements of Q are the 7 quantities 
defined as 

Gww = ^L = ~W - m - m 2 )) = A, (A.7) 
g (au)(M = - ^ fl = (/?J) 2 (g - m 2 ) = S, (a ^ (3), (A.8) 



d 2 G 
dq a pdq a p 



g mm = ^ = -«[i - «(i - (,«/) 2 )] 



-«[1 - «(1 - g 2 )] = P, (c^/3). (A.9) 



dq a(3 dq, 



K (q ~~ Q ) = Qi a ) /3 and 7 are all different. (A. 10) 



a 2 c 



SfeflW = " r = ^[((T-AV) - (aV 3 ) 2 ] = ^(tanh 4 ^ - g 2 ) = fl, 

a, /9, 7 and 5 are all different. (A. 11) 

d 2 G 

G(af3)(av) = ~ — ^— - = K/3Jm(l - q)S ul = C5 ul , (a 7^ /?). (A.12) 
d 2 G 



MA^7)- (A.13) 
Here, Si = ^/^qx + /9 Jm. We list the eigenvalues, their degeneracies and eigenvectors. 

Aj 1}± = i{X ± VY 2 + Z}, degeneracy: 1 for each, (A. 14) 

X = A+(n-l)B + P + 2(n-2)Q+ {n ~ 2) ^ 3) R, 

Y = A + (n-l)B-P-2(n-2)Q- ( n ~ 2 K ra ~ 3 ) ^ 

Z = 2(n-l){2C+(n-2)D} 2 , 
e? = a,e? = 0,e? = 0,^ = 6, 
Af } =A+(n-l)S, degeneracy: 2, (A.15) 
e « = 0, = a, rf ^ = 0, // = 2 or 3 , 
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Aj, 1}± = ^{X'± yj (Y 1 ) 2 + Z'}, degeneracy: (n - 1) for each, 

X' = A - B + P + {n - 4)Q - (n - 3)R, 
Y' — A — B — P — (n — A)Q + (n — 3)R, 
Z' = A(n-2)(C -D) 2 , 

el — ci, e" = di, 62 = 0, €3=0, 9,9 is some replica index, 
^ = ^ = f 7V al3 = g, a^9 and 0^0, 
A — B, degeneracy: 2(n — 1), 

= c 2 , = c?2, = 0, a ^ 9, v ^ ^l, 9 is some replica index , /i 



a/3 



0, for any a, /3, 



A, 



7/ 

P — 2Q + i?, degeneracy: w( -"~ 1 ' > 



n. 



^ 2 



€[' = h!,(% = h2,e% = 0,6i ^ 9 2 ,a ^ 6i,a ^ 6 2 ,v ^ 1, 
9 1 and 6> 2 are some replica indexes, 
rf^ = u , n 9ia = rf 2a = v, n a/3 = w, 

a ^9 1 ,a^9 2 and [3^9 U {3^ 9 2 . 



Appendix A. 2. Mixed state with 3 patterns 
We put mi = m 2 = m 3 = m - 2 m is defined by 

S = ^fnqx + m ^ = V^ x + P Jm (€i + 6 + 6) = S m . (A.20) 



Now, we list the non-zero elements of 

<9 2 G 



= = -PJ+(PJ) 2 {l - [(tanh ~ m ) 2 ]} = A 1 



(A.21) 



Since this quantity does not depend on v, we define it A±. In the below, we assume 
H^v and a, (5, 7 and 5 are all different. 



(A.22) 



d 2 G 



((3J) 2 {[(a^)]-[(a a )C(^)C]} 



dm^dniv 

= (/3J) 2 {[tanh 2 ~ m ] - [(tanh~ m ) 2 ]} 
= ( / 3J) 2 {g-[(tanhS m ) 2 ]} = J B 1 . 
At the last line, we used the following relations, 

q = \(a a a p ) 



tanh E r 



m: 



(a a )C = tanhS m r 



m u = m. 



(A.23) 

(A.24) 
(A.25) 
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d 2 G 



([3J) 2 {tanh 2 ~ m Ce - [(tanhS m ) 2 er]} = B 2 , 



= k(3J< tanhS m ^ — [tanh E m • tanh 



C/3j{m — [tanh 2 E m ■ tanhS m ^]| = C, 



d 2 G 



^j[(M^-(^(Of] 



G(af3)(af3) 



dq a f}dmi 

K/9j|[tanh 3 S m £"] — [tanh 2 S m • tanhS m ^]| = D, 
d 2 G 



dq 2 



a/3 



= -K + K 2 {l-[{a a a p ) 2 }} 



-/t + /€ 2 {l-[(tanh 2 S m ) 2 ]} = P, 

u ^ 2r/ n „P„a„~i\ l„aB\1-\ 

— -- = K [{a aaa) - {(ra)] 

/t 2 {[tanh 2 S m ] - [(tanh 2 H m ) 2 ]} 
K 2 {g-[(tanh 2 ~ m ) 2 ]} = Q, 

d 2 G 



dq a( sdq jS 

= «; 2 {[tanh 4 S m ] - [(tanh 2 ~ m ) 2 ]} = R. 
We list the eigenvalues, their degeneracies and eigenvectors. 



-{X ± \/Y 2 + Z}, degeneracy: 1 for each, 
X = A+(n-l)B + P + 2(n-2)Q+ (n ~ 2) ( n ~ 3) R, 
Y = A + (n - 1)5 - P - 2(n - 2)Q - (^~2)(n-3) ^ 
Z = 6(n - 1){2C + (n - 2)L>} 2 , 



A = Ai + (n-l)Bi, £ 



2(A 2 + (w - l)fl 2 ) 
ra-1 



,<* _ ,a 
e l _ e 2 



a,?7 



a/3 



Ai - A 2 + (n - l)(Bi - B 2 ), degeneracy: 2, 

e? = a[, e a 2 = a' 2 , e« = a' 3 , a[ + a' 2 + a' 3 = 0, ^ = 0, 



x(l)± 
A 2 



-{X' ± y (V) 2 + Z'}, degeneracy: (n - 1) for each, 
X' = A 1 -B 1 + 2{A 2 -B 2 ) + P + (n- 4)Q - (n - 3)i?, 
y' = A ± - B x + 2{A 2 -B 2 )-P-(n- 4)Q + (n - 3)i2, 
Z' = 12(n-2)(C-D) 2 , 
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(A.26) 



(A.27) 



(A.28) 



(A.29) 



(A.30) 

(A.31) 
(A.32) 



(A.33) 
(A.34) 
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Ai — A 2 — (Bi — B 2 ), degeneracy: 2(n — 1), 

e l — c l> e l — ^1) e 2 = C 2) e 2 = ^3 = C3, €3 = C?3, 



(A.35) 



a 7^ # is some replica index, 



d — (1 — n)di, di + d 2 + ds = 0, 




(A.36) 



a^6 1 ,a^6 2 and (3^0^(3^ 6 2 . 



Appendix A. 3. Spin Glass 

For the spin glass solution, m M = and q 7^ 0. Thus, we only have to put 
m = 0,C = D = 0in the quantities for the Hopfield attractor. Thus, we obtain 
the following eigenvalues: 



References 

[1] Coolen A C C, Penney R W and Sherrington D 1993 Phys. Rev. B 48 16116 

[2] Penney R W, Coolen A C C and Sherrington D 1993 J. Phys. A: Math. Gen. 26 3681 

[3] Penney R W and Sherrington D 1994 J. Phys. A: Math. Gen. 27 4027 

[4] Dotsenko V, Franz S and Mezard M 1994 J. Phys. A: Math. Gen. 27 2351 

[5] Uezu T and Coolen A C C 2002 J. Phys. A: Math. Gen. 35 2761 

[6] Abe K 2008 Masters thesis, Graduate School of Humanities and Sciences, Nara Women's 

University, Nara [In Japanese] 
[7] Hara K, Miyoshi S, Uezu T and Okada M 2008 Proceeding of International Conference on Neural 

Information Processing . 
[8] Kimoto T et al 2008 in preparation 

[9] de Almeida J R L and Thouless D J 1978 J. Phys. A: Math. Gen. 11 983 




A+(n-l)B = AS 2) = AS 3) , 



P + (n - 1)Q - (n - 3)R = A 2 = X ( 2 \ 
P-2Q + R. 




(A.37) 

(A.38) 

(A.39) 
(A.40) 
(A.41) 



